TITLE OF THE INVENTION 

SELECTION OF IMAGE DATA FOR OUTPUT 

BACKGROUND OF THE INVENTION 
5 Field of the Invention 

[0001] The present invention relates to an image data processing 
technique for executing image data output decisions. 

Description of the Related Art 

10 [0002] Image data generated by an image generating device is output 
from a suitable output device according to user preference. Known image 
output devices include CRTs, LCDs, printers, projectors, and television 
receivers; known image generating devices include digital still cameras 
(DSCs), and digital video cameras (DVCs). 

15 [0003] Image data generated by an image generating device is 
sometimes generated under improper operating settings. Examples of such 
image data include image data focused on a subject other than the intended 
subject. Additional examples are cases of improper exposure resulting in 
an image that is too bright or too dark; and cases where camera shake 

20 caused by an unstead}' hand during shooting results in a blurred image. 
These improper images are typically not desired to output. In such 
instances, it is typically necessary for the user, when outputting images 
from an output device, to select whether or not a particular image should be 
output; and this selection process is particularly arduous where a large 

25 number of images are being handled. 

SUMMARY OF THE INVENTION 

[0004] It is therefore an object of the present invention to carrying out 
automatically select suitable images for output. 
30 [0005] In order to attain at least part of the aforementioned problem, 
there is provided an image output device for outputting an image using 

- 1 - 

PF04J261US 



image data generated by an image generating device and image generation 
record information that is associated with the image data and that includes 
operation information for the image generating device at the time that the 
image data is generated. The image output device comprises an image 
5 data processing device and an output section. The image data processing 
device comprises an analyzer for analyzing at least one of the image data 
and the image generation record information, and for determining, on the 
basis of the image data, an image quality parameter relating to quality of 
an image; and a selector for performing, on the basis of the image quality 

10 parameter, a output target decision regarding whether to select each image 
data as an output target. The output section outputs an image using the 
image data that has been selected as the output target by the selector. 
[0006] The image output device according to this invention performs 
appropriately selection of image data for output, on the basis of at least 

15 either image data or image generation record information. 

[0007] This invention may be embodied in various ways, for example, an 
image output method and image output device; an image data processing 
method and image data processing device; a computer program for idealizing 
the functions of such a method or device; a storage medium having such a 

20 computer program stored thereon; and a data signal embedded in a carrier 
wave containing such a computer program. 

[0008] These and other objects, features, aspects, and advantages of the 
present invention will become more apparent from the following detailed 
description of the preferred embodiments with the accompanying drawings. 

25 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0009] Fig. 1 illustrates an example of an image output system as an 
embodiment of the invention. 

[0010] Fig. 2 is a block diagram showing a simplified arrangement of a 
30 digital still camera 12. 

[0011] Fig. 3 is a conceptual illustration of an example of an 
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arrangement within an image file. 

[0012] Fig. 4 illustrates an example of data structure of an ancillary 
information storage field 103. 

[0013] Fig. 5 illustrates of an example of data structure in an Exif data 
field. 

[0014] Fig. 6 is a block diagram showing a simplified arrangement of a 
computer PC. 

[0015] Fig. 7 is a block diagram showing a simplified arrangement of a 
printer 20. 

[0016] Fig. 8 is a block diagr am showing an arrangement of printer 20, 
centered on the control circuit 30. 

[0017] Fig. 9 is a flowchart showing flow of an image file GF generation 
process. 

[0018] Fig. 10 is a flow chart showing flow of image data processing. 
[0019] Fig. 11 is as flow chart showing a processing routine in a output 
target selection process. 

[0020] Figs. 12(a)- 12(c) illustrate an output target decision process in the 
first embodiment of image selection based on sharpness characteristics. 
[0021] Fig. 13 illustrates an example of a pixel array. 
[0022] Fig. 14 illustrates confirming output target image data. 
[0023] Figs. 15(a)-15(c) illustrate a weight W distribution. 
[0024] Figs. 16(a)- 16(c) illustrate a output target decision process in the 
second embodiment of image selection based on sharpness characteristics. 
[0025] Figs. 17(a)- 17(c) illustrate another weight W distribution. 
[0026] Figs. 18(a)- 18(c) illustrate still another weight W distribution. 
[0027] Figs. 19(a) and 19(b) illustrate a output target decision process in 
the third embodiment of image selection based on sharpness characteristics. 
[0028] Figs. 20(a)-20(c) illustrate another weight W distribution. 
[0029] Figs. 21(a)-2l(c) illustrate still another weight W distribution. 
[0030] Figs. 22(a), 22(bl), 22(b2), 22(d), 22(c2), and 22(d) illustrate a 
output target decision process in the fourth embodiment of image selection 
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based on sharpness characteristics. 

[0031] Figs. 23(a)-23(d) illustrate a output target decision process in the 
first embodiment of image selection based on brightness characteristics. 
[0032] Figs. 24(a)-24(d) illustrate a output target decision process in the 
5 second embodiment of image selection based on brightness characteristics. 
[0033] Figs. 25(a) -25(c) illustrate a output target decision process in the 
first embodiment of image selection based on camera shake characteristics. 
[0034] Figs. 26(a)-26(c) illustrate a output target decision process in the 
second embodiment of image selection based on camera shake 

1 0 char acte ristics . 

[0035] Figs. 27(a)-27(c) illustrate a output target decision process in the 
third embodiment of image selection based on camera shake characteristics. 
[0036] Figs. 28(a)-28(c) illustrate a output target decision process in the 
fourth embodiment of image selection based on camera shake 

1 5 characteristics . 

[0037] Fig. 29 illustrates the relationship between a threshold value and 
lens focal length. 

[0038] Fig. 30 illustrates another example showing an user interface for 
confirmation of output target image data. 
20 [0039] Fig. 31 illustrates another example of an output system as an 
embodiment of the invention. 

DESCRIPTION OF THE PREFERRED EMBODIMENT 

[0040] The embodiments of the present invention are described 
25 hereinbelow through certain specific preferred embodiments, in the 
following order. 

A. Arrangement of Image Output System 

B. Arrangement of Image File 

C. Arrangement of Image Data Processing Device 
30 D. Arrangement of Image Output Device 

E. Image Processing in Digital Still Camera 
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F. Image Selection Based on Sharpness Characteristic of an Image 

G. Image Selection Based on Brightness Characteristic of an Image 

H. Image Selection Based on Camera Shake Characteristic of an Image 

I. Example Arrangement of Another Output Target Confirmation 

5 Process 

J. Example Arrangement of Another Image Output System 
K. Variant Examples 
[0041] A. Arrangement of Image Output System- 
Fig. 1 is an illustration showing an example of an image output 

10 system in which an output device may be implemented, as an embodiment 
of the invention. Image output system 10 comprises a digital still camera 
12 as an image generating device for generating image files; a computer PC 
as an image data processing device for executing output target decisions on 
the basis of image files; and a printer 20 as an image output device for 

15 outputting images. Image files generated by digital still camera 12 are 
transferred to computer PC via a cable CV, or by directly inserting into 
computer PC a memory card MC on which image files are stored. 
Computer PC executes an output target decision regarding the image data 
contained in the read out image file, and sends image data decided to be an 

20 output target to printer 20 via a cable CV. Printer 20 then outputs an 
image using the read out image data. As the image output device, a CRT 
display, LCD display, or other monitor 14, a projector, or the like could be 
used in addition to or instead of printer 20. The following description 
assumes direct insertion of a memory card MC into computer PC. The 

25 computer PC serving as the image data processing device and the printer 
serving as the image output device can together be termed an "output 
device", broadly defined. 

[0042] Fig. 2 is a block diagram showing a simplified arrangement of a 
digital still camera 12. The digital still camera 12 of this embodiment 
30 comprises an optical circuit 121 for collecting optical information; an image 
acquisition circuit 122 for controlling the optical circuit to acquire an image; 
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an image processing circuit 123 for processing acquired digital images; a 
flash 130 serving as a supplemental light source; and a control circuit 124 
for controlling the various circuits. Control circuit 124 comprises memory, 
not shown. 

5 [0043] Digital still camera 12 stores acquired images on a memory card 
MC. The typical storage format of image data in digital still camera 12 is 
the JPEG format, but other storage formats, such as TIFF format, GIF 
format, BMP format, or RAW data format could be used. 

[0044] Digital still camera 12 further comprises a Select/Set button 126 

10 for setting various shooting parameters (e.g. aperture value, shutter speed, 
exposure adjustment mode, flash mode, subject area, shooting mode, etc.); 
and a liquid crystal display 127. Liquid crystal display 127 is used to 
preview photographed images, and when setting the aperture or other 
parameters using the Select/Set button 126. 

15 [0045] Aperture value may be set to values within an available range 
according to the model of digital still camera 12; for example, it may be set 
to certain predetermined discrete numbers from 2 to 16 (e.g., 2, 2.8, 4, 5.6 ... 
etc.). F number is typically used for aperture value. Accordingly, a larger 
aperture value, or a larger F number, means a smaller aperture. 

20 [0046] Exposure adjustment mode can be one selected from among a 
number of modes set in advance, for example, program auto mode (normal 
program mode), aperture priority mode, shutter speed priority mode, and 
manual mode. When set to program auto mode, aperture value and 
shutter speed are adjusted automatically to standard values, in order to set 

25 exposure to a standard value. When set to manual mode, user-set aperture 
value and shutter speed are used. An arrangement whereby, with aperture 
value and shutter speed set by the user, an exposure adjustment mode 
using those settings is selected automatically is also possible. 
[0047] Flash mode is a parameter that controls operation of the flash 130, 

30 and can be one selected from among a number of modes set in advance, for 
example, auto flash mode, flash off mode, compulsory flash mode, etc. 
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[0048] Subject area is a shooting parameter that indicates the position of 
the subject in an image, and can be user-set by setting coordinates in the 
image. By additionally setting a circle or rectangle of a desired size 
centered on the set coordinates, the position and size of the subject within 
5 the image can be indicated. 

[0049] Shooting mode or scene mode can be selected from among a 
number of predetermined modes such as standard mode, portrait mode, 
landscape mode, and night scene mode. Where one of these shooting modes 
has been selected, related parameters (shutter speed, flash mode, etc.) are 
10 set automatically depending on the selected mode. For example, where 
standard mode has been selected as the shooting mode, parameters relating 
to image generation are set to standard values. 

[0050] When a photograph has been taken with a digital still camera 12, 
image data and image generation record information are stored as an image 

15 file in memory card MC. Image generation record information can include 
shutter speed and other parameter settings at the time of shooting (time of 
generation of image data) as described later in detail. 
[0051] B. Arrangement of Image File: 

Fig. 3 is a conceptual illustration of an example of an 

20 arrangement within an image file that can be used in this embodiment. 
Image file GF comprises an image data storage field 101 for storing image 
data GD; and an image generation record information storage field 102 for 
storing image generation record information GI. Image data GD is stored, 
for example, in JPEG format, while image generation record information GI 

25 is stored, for example, in TIFF format (a format in which data and data 
fields are specified using tags). The terms file structure and data structure 
in this embodiment refer to file or data structure in the form in which a file 
or data etc. is stored in a memory device. 

[0052] Image generation record information GI is information relating to 
30 an image when image data is generated (shot) by digital still camera 12 or 
other such image generating device, and includes the following settings. 
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• aperture value 

• exposure time 

• shutter speed 

• lens focal length (converted to 35 mm film basis) 
5 • flash (Flash On/OfO 

• subject area 

• exposure adjustment mode 

• shooting mode (scene mode) 

• maker name 
10 • model name 

• gamma value 

[0053] The image file GF in this embodiment may basically comprise the 
aforementioned image data storage field 101 and image generation record 
information storage field 102; or may have a file structure according to an 
15 existing standardized file format. The following specific description 
pertains to the case where the image file GF pertaining to this embodiment 
conforms to the Exif file format. 

[0054] An Exif file has a file structure in accordance with the digital still 
camera image file format specification (Exif); the specification has been 

20 proposed by the Japan Electronics and Information Technology Industries 
Association (JEITA). Similar to the conceptual diagram in Fig. 3, the Exif 
file format comprises a JPEG image data storage field for storing image 
data in the JPEG format; and an ancillary information storage field for 
storing information of various kinds relating to stored JPEG image data. 

25 The JPEG image data storage field corresponds to the image data storage 
field 101 in Fig. 3, and the ancillary information storage field to the image 
generation record information storage field 102. The ancillary information 
storage field stores image generation record information relating to a JPEG 
image, such as shooting date/time, shutter speed, and subject area. 

30 [0055] Fig. 4 illustrates an example of data structure of ancillary 
information storage field 103. In the Exif file format, hierarchical tags are 
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used to designate data fields. Each data field can contain a plurality of 
subordinate data fields identified by subordinate tags. In Fig. 4, areas 
enclosed by rectangles represent single data fields, with tag names noted at 
upper left. In this embodiment, three data fields whose tag names are 
5 APPO, APP1, and APP6 are contained. The APP1 data field contains 
within it two data fields whose tag names are IFDO and IFD1. The IFDO 
data field contains three data fields whose tag names are PM, Exif, and GPS. 
Data and data fields are stored according to a prescribed address or offset 
value; address or offset value can be searched by means of tag name. On 
10 the output device end, data corresponding to desired information can be 
acquired by means of specifying an address or offset value corresponding to 
the desired information. 

[0056] Fig. 5 illustrates an example of data structure (data tag names 
and parameter values) in the Exif data field in Fig. 4, wherein tag name can 
15 be referenced by tracing in the order APPl-IFDO-Exif. As shown in Fig. 4, 
the Exif data field can include a data field whose tag name is MakerNote; 
the MakerNote data field can in turn include a plurality of items of data, 
although these are omitted in Fig. 5. 

[0057] As shown in Fig. 5, the Exif data field stores parameter values 
20 relating to information such as aperture value, exposure program, exposure 
time, shutter speed, flash, lens focal length (converted to 35 mm film basis), 
and subject area. 

[0058] Aperture value is information relating to the aperture value at 
the time of image generation; F number is used as the aperture value in this 
25 embodiment. Accordingly, a larger aperture value or a larger F number 
means smaller aperture. 

[0059] Exposure program is information that identifies an exposure 
adjustment mode, can be selected from among a number of values including 
the following four values, for example. 
30 Parameter value 1- manual mode 

Parameter value 2- normal program mode 
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Parameter value 3« aperture priority mode 

Parameter value 4' shutter speed priority mode 
[0060] Exposure time is information relating to the time interval for 
which the image generating device receives light during generation of an 
5 image; the parameter value records the exposure time in units of seconds. 
[0061] Shutter speed is information relating to the shutter speed value 
at the time of image generation; the parameter value records shutter speed 
in APEX units. Shutter speed and exposure time each signify a time 
interval for which the image generating device receives light during 
10 generation of an image, and are basically the same value converted to 
different units. 

[0062] Flash information is information relating to operation of the flash, 
and can be used to decide whether illumination has been provided by a 
supplemental light source. The parameter value having the tag name 
15 Flash can include four sets of information relating to operating modes and 
operation result thereof. Operating mode may be set from among a 
plurality of values including the following three values, for example. 

1- compulsory flash mode 

2- flash off mode 
20 3* auto flash mode 

[0063] Operation result may be set from among two values, Flash on or 
Flash off, for example. The decision as to whether or not there was 
illumination by the supplemental light souixe during generation of image 
data may be carried out using this operation result. 

25 [0064] Among image generating devices, certain devices are equipped 
with a mechanism for sensing reflected light from a subject illuminated 
with light from a flash. In the event that a flash cover or other obstacle 
blocks the flash light, or the flash does not fire despite being operated, no 
light illuminates the subject. Such instances can be identified through the 

30 presence or absence of reflected light. Flash information can include 
information relating to the presence/absence of a reflected light sensing 
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mechanism, and to the presence/absence of reflected light sensed at the time 
of shooting. In the event that a reflected light sensing mechanism is 
present and sensed reflected light is absent, it can be decided that no 
illumination has been provided by the supplemental light source, even if the 
aforementioned operation result is Flash on. 

[0065] Lens focal length (converted to 35 mm film basis) is information 
relating to the distance between the center of the lens and its focal point, i.e., 
film or photoreceptor element such as a CCD; the parameter value records 
the distance in mm units. This parameter value is a value obtained by 
converting actual lens focal length to lens focal length in a camera that uses 
35 mm, under conditions that maintain the ratio of photoreceptor element 
size to lens focal length. 

[0066] Subject area is information indicating the position of a subject in 
an image, and center coordinates of the subject area are set as the 
parameter value. Where a circular or rectangular area is set to indicate 
the size of the subject, the radius of the circle or width of the rectangle can 
be set in association therewith. 

[0067] Information associated with image data is also stored 
appropriately in fields other than the Exif data field in Fig. 4. For example, 
maker name and model name are stored in the data field whose tag name is 
IFD0, as information identifying the image generating device. 
[0068] C. Arrangement of Image Data Processing Device^ 

Fig. 6 is a block diagram showing a simplified arrangement of the 
computer PC in this embodiment. Computer PC comprises a CPU 150 for 
executing image data processing; RAM 151 for temporarily storing results of 
operations by CPU 150, image data, and the like; and a hard disk drive 
(HDD) 152 for storing data needed for image data processing, such as an 
output target decision program. Computer PC further comprises a memory 
card slot 153 for installing a memory card MC, and for acquiring data from 
memory card MC; a monitor drive circuit 154 for driving a monitor 14; and 
an I/F circuit 155 for interface with printer 20, and digital still camera 12. 
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I/F circuit 155 incorporates interface circuits designed in consideration of 
ease of connection to printer 20 and digital still camera 12. Parallel 
interface circuits, and universal serial bus interface circuits may be used as 
such interface circuits. 
5 [0069] An image file GF generated by a digital still camera 12 is 
supplied to computer PC via a cable or via a memory card MC. When an 
image data processing application program, either an image retouching 
application or a printer driver, is started up by a user operation, CPU 150 
analyzes the image file GF and executes image data processing to perform 

10 an output target decision. That is, CPU 150, RAM 151, and HDD 152 
function as an analyzer and selector. The image data processing 
application program may be set up to run automatically when a memory 
card MC is inserted into memory card slot 153, or when connection of a 
digital still camera 12 to I/F circuit 155 via a cable is detected. The 

15 specifics of image data processing executed by CPU 150 are described later 
in detail. 

[0070] Image data selected as an output target by CPU 150 is 
transferred to an image output device, for example, printer 20, whereupon 
the image output device receiving the image data executes image output. 

20 [0071] D. Arrangement of Image Output Device- 

Fig. 7 is a block diagram showing a simplified arrangement of 
printer 20 in the present embodiment. Printer 20 is, for example, an ink 
jet printer that ejects ink of four colors, cyan C, magenta M, yellow Y, and 
black K, on a print medium to reproduce an color image. An 

25 electro-photographic printer that transfers and fixes toner onto a print 
medium may also be used. In addition to the four colors indicated above, 
light cyan LC which is lighter in density than cyan C, light magenta LM 
which is lighter in density than magenta Mg, dark yellow DY which is 
darker in density than yellow Y may be used as ink. Where 

30 monochromatic printing is performed, the arrangement may instead employ 
black K only; or red R or green G may be additionally used. The type of ink 
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or toner used can be selected depending on the characteristics of the image 
for output. 

[0072] Printer 20 comprises a mechanism for driving a print head 211 
mounted on a carriage 21, to eject ink and form dots; a mechanism for 
5 reciprocating carriage 21 in the axial direction of a platen 23 by means of a 
carriage motor 22; a mechanism for feeding printer paper P by means of a 
paper feed motor 24; and a control circuit 30. The mechanism for 
reciprocating carriage 21 in the axial direction of a platen 23 is composed of 
a slide rail 25 extending parallel to the axis of platen 23, for slidably 

10 retaining carriage 21; a pulley 27 coupled via an endless drive belt 26 to a 
carriage motor 22; and a position sensor 28 for sensing the home position of 
carriage 21. The mechanism for feeding printer paper P is composed of 
platen 23; paper feed motor 24 which rotates platen 23; an auxiliary paper 
feed roller, not shown in the drawing; and a gear train (not shown) for 

15 transmitting rotation of paper feed motor 24 to platen 23 and the auxiliary 
paper feed roller. 

[0073] Control circuit 30 exchanges signals with a printer control panel 
29 while appropriately controlling operation of paper feed motor 24, carriage 
motor 22, and print head 211. Printer paper P supplied to printer 20 is set 

20 pinched between platen 23 and the auxiliary paper feed roller, and 
advanced by a predetermined amount through the rotation of platen 23. 
[0074] Carriage 21 has a print head 211, and is designed for installation 
of an ink jet cartridge of utilizable ink. On the bottom face of print head 
211 are disposed nozzles for ejecting utilizable ink (not shown). 

25 [0075] Fig. 8 is a block diagram showing an arrangement of printer 20 
including the control circuit 30. Within control circuit 30 are disposed a 
CPU 31, PROM 32, RAM 33, a memory card slot 34 for a memory card MC, 
a peripheral device input/output section (PIO) 35 for exchanging data with 
paper feed motor 24, carriage motor 22, and a drive buffer 37. Drive buffer 

30 37 is used as a buffer for supplying dot on/off signals to print head 211. 
These components are interconnected by a bus 38, enabling exchange of 
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data among them. Control circuit 30 is also provided with a transmitter 39 
for outputting a drive waveform at predetermined frequency, and a 
distributed output device 40 for distributing the output of transmitter 39 to 
print head 211 at predetermined timing. 

[0076] CPU 31 analyzes print data supplied from computer PC, acquires 
dot data, and while synchronizing with operation of paper feed motor 24 and 
carriage motor 22, outputs the dot data to drive buffer 37 at predetermined 
timing. An image based on the print data is output as a result. 
[0077] E. Image Processing in Digital Still Camera: 

Fig. 9 is a flowchart showing a process flow for generating an 
image file GF in digital still camera 12. 

[0078] Control circuit 124 (Fig. 2) of digital still camera 12 generates 
image data GD in response to a shoot request, for example, depression of a 
shutter button (Step S90). Where shutter speed, shooting mode and other 
parameter settings have been made, image data GD is generated using the 
set parameter values. 

[0079] Control circuit 124 stores the generated image data GD and 
image generation record information GI as an image file GF on memory 
card MC (Step S92), and terminates the processing routine. Image 
generation record information GI includes parameters used at the time of 
image generation, such as shutter speed, exposure time, shooting mode, and 
other arbitrarily set parameter values, and parameter values set 
automatically, such as maker name, and model name. Image data GD also 
stores as image file GF [image information] that has been converted from 
the RGB color space to the YCbCr color space, and compressed in JPEG 
format. 

[0080] By means of the aforementioned processes executed in digital still 
camera 12, both image data GD and image generation record information 
GI that includes various parameter values at the time of generation of 
image data is set in the image file GF stored on memory card MC. 
[0081] F. Image Selection Based on Sharpness Characteristic of an 
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Image- 

Fl. Embodiment 1 of Image Selection Based on Sharpness Characteristic 
of an Image- 

Fig. 10 is a flow chart showing a process flow of image data 
5 processing executed in the image data processing device of this embodiment. 
When a memory card MC including an image file GF has been inserted into 
memory card slot 153, CPU 150 (Fig. 6) of computer PC, which is the image 
data processing device, reads out the image file GF (Fig. 3) from memory 
card MC (Step S100). Next, in Step S102, CPU 150 executes a process to 

10 select one or more images as output target, and next in Step S104, executes 
a process for permitting user confirmation of the output target images 
selected in Step S102. These two steps (S102, S104) will be described later 
in detail. Next, in Step S106, CPU 150 outputs the output target images to 
an image output device, and terminates the processing routine. 

15 [0082] Fig. 11 is a flow chart showing a processing routine for one image 
file in the output target selection process (corresponding to Step S102 in Fig. 
10). In Step S110, CPU 150 (Fig. 6) of computer PC searches the ancillary 
information storage field of image file GF for image generation record 
information GI indicating information at the time the image data was 

20 generated. In the event that image generation record information GI is 
found (Step Si 12- Y), CPU 150 acquires the image generation record 
information GI, and using the image generation record information GI, 
executes an output target decision process, described later, records the 
decision result in RAM 151 (Step S114), and terminates the processing 

25 routine. 

[0083] An image file created by a drawing application or the like, on the 
other hand, will not contain image generation record information GI having 
information such as shutter speed. If CPU 150 cannot find image 
generation record information GI (Step SI 12- N), it records in RAM 151 a 
30 decision result designating the image file as an output target (Step Si 16), 
and terminates the processing routine. 
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[0084] Where a plurality of image files are present, for example, if a 
memory card contains a plurality of image files, CPU 150 executes the 
process of Fig. 11 on each image file. As a result, output target decision 
results for all image files are recorded in RAM 151. The flow of the 
processes of Figs. 9 -11 is the same in the other embodiments described 
hereinafter. 

[0085] Figs. 12(a)- 12(c) illustrate the output target decision process of 
this embodiment. Image IMG12a shown in Fig. 12(a) contains a human 
figure in the center, and trees in the background. Image IMG 12b shown in 
Fig. 12(b) captures the same subject as image IMG12a, but differs from 
image IMG12a in that the contours are blurred. Such blur may occur, for 
example, where the camera is out of focus when the image data is generated, 
or in the case of camera shake. In output target decision process of this 
embodiment, CPU 150 (Fig. 6) selects, as output targets, images in which 
contours are sharp, as with image IMG12a, while excluding from output 
targets images in which contours are blurred and unsharp, as with image 
IMG12b. In order to make this decision, CPU 150 analyzes image data; 
uses edge amount to determine a sharpness characteristic value relating to 
sharpness in an image as an image quality parameter value; and makes a 
decision on the basis of this sharpness characteristic value. 
[0086] The sharpness characteristic value may be obtained, for example, 
as an average edge amount value in the image. Edge amount is the 
magnitude of variation in the brightness value. The difference in 
brightness value from pixels in proximity to a certain pixel location may be 
employed as the edge amount for the pixel location. This difference can be 
calculated by a number of different methods, for example, using the Prewitt 
operator. As shown in Fig. 13, a plurality of pixels are arranged in an X 
axis direction and in a Y axis direction, with P(i, j) representing the 
brightness value of the pixel at the i'-th position along the X axis and the 
fth position along the Y axis. Here, the arithmetic expression for edge 
amount E(i, j) at pixel position (j, j) by the Prewitt operator is represented 
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by the following arithmetic expression. 
[0087] 

E(iJ) = jAJx 2 +AJy 2 
Afx= {/>(/ + \J + l)-/>(/- l,y+l)} 
+ {/>(/ + 1,7 )-P(i-lJ )} 

+ {P(/ + l,y-l)^/>(/-l,y-l)} 

+ {/>(/ J-l)-P(i ,7 + 0} 
+ {/>(/ + l,y -!)-/>(/ + 1,7+1)} 



5 [0088] Where image data is expressed in a color space that does not 
include brightness value as a parameter, for example, where represented by 
an RGB color space, brightness values at pixel positions can be obtained by 
first converting it to a color space that includes brightness value as a 
parameter, for example, an HSL color space, and YCbCr color space. 

10 [0089] Fig. 12(c) shows the output target decision process of this 
embodiment. In this embodiment, image data whose average edge amount 
Eave, as calculated using the above arithmetic expression, is equal to or 
greater than a predetermined threshold value is selected as an output 
target. Image data whose average edge amount Eave is less than the 

15 predetermined threshold value is excluded from an output target. In a 
sharp image having distinct contours, since the contours of the subject in 
the image are distinct, pixels having large edge amount tend to be more 
numerous. On the other hand, in an unsharp image having blurred 
contours, since the contours of the subject in the image are blurred, pixels 

20 having small edge amount tend to be more numerous. That is, in a sharp 
image, average edge amount Eave tends to be large, whereas in a blurred 
image average edge amount Eave tends to be small. Thus, by selecting as 
output targets images whose average edge amount Eave is equal to or 
greater than a threshold value, blurred images can be excluded from output 

25 targets. As a threshold value of this kind, there could be used a value 
determined on the basis of sensory test of image output results. For 
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example, where the possible range for brightness value is 0-255, a threshold 
value of 20 could be used. It should be noted that, in this embodiment, the 
image quality parameter value (average edge amount) is determined by 
means of analysis of the image data only, without utilizing image 
5 generation record information. 

[0090] Fig. 14 illustrates confirming of output target images on monitor 
14. The screen shown in Fig. 14 enables the user to confirm or modify 
output target images in the output target confirmation process illustrated in 
Fig. 10 (Step S104). As shown in the drawing, a list of images represented 

10 by a plurality of image files are shown on the screen. To the bottom left of 
each image is shown a number for identifying the image, and to the lower 
right of the image is shown a number for image outputs, shown to the right 
of an "x". For example, "xl" means that one copy of the image is to be 
output, and "xO" means that no copy of the image is to be output. The 

15 number for image output is set in Step S102 (Fig. 10), on the basis of the 
output target decision result recorded in RAM 151 (Fig. 6). In this 
embodiment, image data selected as an output target is set to "1", and 
image data to be excluded as an output target is set to "0". In the example 
in Fig. 14, the output number of the three sharp images, i.e. Nos. 1, 2, and 4, 

20 are set to 1, and the output number of the unsharp image, i.e. No. 3, is set to 
0. 

[0091] In the screen in Fig. 14, it is possible for the user to select any 
image and change the output number. The selected image is displayed 
with a border around the selected image. In the example in Fig. 14, image 

25 No. 2 has been selected. To the lower right of the border around the 
selected image are displayed arrows for changing the output number. By 
manipulating the arrows, the user is able to increase or decrease the output 
number. That is, by adjusting the output number, the user can modify 
output target image data. To the right of the screen in Fig. 14 is displayed 

30 information relating to the selected image. In this example, average edge 
amount, which is the image quality parameter used in the output target 
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decision, is shown. The user can refer to this information while changing 
the output number of the image. In this example, an output number of 0 
has been preset for blurry images, enabling the user to reduce the amount of 
effort needed to perform the operation of excluding blurry images as output 
5 targets. 

[0092] In the screen in Fig. 14, when the user confirms output number 
and operates the Start Output button at the lower right of the screen, CPU 
150 (Fig. 6) moves to the next step, which is the transfer process (Fig. 10- 
S106). In the transfer process, CPU 150 transfers image data depending 
10 on its output number (output target image data) to printer 20 which is the 
image output device. Printer 20 then outputs the images on the basis of 
the received image data. 

[0093] F2. Embodiment 2 of Image Selection Based on Sharpness 
Characteristic of an Image: 

15 Figs. 15(a)- 15(c) illustrate a weight W distribution for use in 

calculating average edge amount in a second embodiment. Fig. 15(b) 
shows a weight W distribution taken along line BB in the image IMG of Fig. 
15(a) (X direction weight distribution); and Fig. 15(c) shows a weight W 
distribution taken along line C"C in the image IMG of Fig. 15(a) (Y direction 

20 weight distribution). In this embodiment, as shown in Figs. 15(a)- 15(c), a 
weighted average of edge amount is calculated using a weight W 
distribution that weights more heavily pixels closer to the center of image 
IMG, and the output target decision process is performed using this 
weighted average. 

25 [0094] Figs. 16(a)- 16(c) illustrate the output target decision process in 
this embodiment. Two images, namely, IMGl6a shown in Fig. 16(a) and 
IMG16b shown in Fig. 16(b), are images of a human figure at center with 
trees in the background. The cross mark in each image indicates the 
center of the image. In image IMGl6a, the human figure at center is sharp, 

30 and the trees in the background are blurry. In image IMGl6b, the human 
figure at center is blurry, and the trees in the background are sharp. 
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Image data such as image IMG 16b could be produced, for example, where 
the focus was on the background rather than the human subject at the time 
that the image data was generated. 

[0095] Below each of the two images IMGl6a and IMG16b is indicated 
an X direction distribution for weight W, shown in Fig. 15(b). The Y 
direction distributions for weight W are omitted from the drawing. 
Weighted average edge amounts obtained using such weights W are greater 
in images in which a subject situated in the center of the image is sharp, 
and smaller in images in which a subject situated in the center of the image 
is blurry, as in image IMG 16b. 

[0096] Fig. 16(c) shows the output target decision process of this 
embodiment. In this embodiment, image data whose weighted average 
edge amount EWave is equal to or greater than a threshold value is selected 
as an output target. Image data whose weighted average edge amount 
EWave is less than the threshold value is excluded as an output target. 
When image data is generated, in most instances, the desired subject is 
positioned at the image center. Thus, in this embodiment, image data in 
which a subject situated in proximity to the image center is sharp, for 
example, image data in which the desired subject is in focus, is selected as 
an output target, while image data in which a subject situated in proximity 
to the image center is blurred, for example, image data in which the desired 
subject is out of focus, is excluded as an output target. 

[0097] The weight W distribution is deter mined such that heavier 
weights are assigned to an area that is desired to be sharper, as compared 
to the weight assigned to other areas. For example, weighted average edge 
amount may consist of an average value for edge amount in a certain 
predetermined area of an image. Figs. 17(a)- 17(c) illustrate a weight W 
distribution for calculating such a weighted average edge amount. In 
image IMG in Fig. 17(a), a predetermined area Al is established. The 
magnitude of weight W is constant in this area Al, and is zero outside of 
this area Al. By so doing, image data in which a subject in proximity to 
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the image center is blurry can be excluded from output images, regardless of 
data lying outside of area Al. Area Al may consist, for example, of an area 
having the same shape as the original image, but smaller than the original 
image (20%, for example), and located in the center of the image. The 
5 magnitude of the weight in area Al may be designed to be larger for pixels 
closer to the center of the image. By so doing, images in which an area in 
proximity to the image center in area Al is blurry can be excluded from 
output images. It should be noted that, in this embodiment, the image 
quality parameter value (weighted average edge amount) is determined by 
10 analyzing the image data only, without utilizing image generation record 
information. 

[0098] F3. Embodiment 3 of Image Selection Based on Sharpness 
Characteristic of an Image* 

Figs. 18(a)- 18(c) illustrates a weight W distribution for use in 

15 calculating weighted average edge amount in a third embodiment. The 
difference from the example in Figs. 15(a)- 15(c) is that line BB and line OC 
pass through the center of the subject area, which is off the center of the 
image. In this embodiment, the image generation record information 
includes, as subject location information, subject area information (Fig. 5), 

20 and CPU 150 (Fig. 6) can acquire center coordinates for the subject area by 
analyzing the image generation record information. As shown in Figs. 
18(a)- 18(c), weights W used for calculating weighted average edge amount 
are designed to be heavier in closer proximity to the center of the subject 
area. 

25 [0099] Figs. 19(a) and 19(b) illustrate the output target decision process 
in this embodiment. Two images, namely, IMGl9a shown in Fig. 19(a) and 
IMG 19b shown in Fig. 19(b), are images of a human figure at center with 
trees in the background. The difference from IMGl6a and IMG16b shown 
in Figs. 16(a) and 16(b) is that a center of a subject area is set within the 

30 image, and that a human subject is arranged not in the center of the image, 
but rather in proximity to the center of the subject area. The two images 
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IMG 19a and IMG 19b each have a cross mark indicated at the center 
coordinate location of the subject area (Fig. 5) obtained by analyzing the 
image generation record information GI associated with the respective 
image data; a rectangular subject area is indicated as well. 
5 [0100] Below each of the two images IMGl9a and IMG19b is the weight 
W distribution in the X direction shown in Fig. 18(b). The Y axis 
distribution is not shown. Weighted average edge amount obtained using 
this weight W will be higher for an image that is sharp in proximity to the 
subject area, as shown by IMG 19a, and lower for an image that is blurry in 

10 proximity to the subject area, as shown by IMG19b. In this embodiment, 
as with the output target decision process shown in Fig. 16(c), image data 
whose weighted average edge amount EWave is equal to or greater than a 
predetermined threshold value is selected as output target image data. 
Image data whose weighted average edge amount EWave is less than a 

15 predetermined threshold value is excluded as an output target. By so 
doing, images in which the subject is sharp in the subject area will be 
selected as output targets, while excluding blurry images as output targets. 
[0101] The weight W distribution is determined such that heavier 
weights are assigned to an area that is desired to be sharper, as compared 

20 to the weight assigned to other areas. For example, weights may be 
assigned only in a certain predetermined area which center is situated at 
the center of the subject area. Figs. 20(a)-20(c) illustrates such a weight W 
distribution. In image IMG in Fig. 20(a), a predetermined area A2 is 
established. The magnitude of weight W is constant in this area A2, and is 

25 zero outside of this area A2. By so doing, image data in which a subject in 
proximity to the center of the subject area is blurry can be excluded as an 
output image, regardless of data lying outside of area A2. Area A2 may 
consist, for example, of an area having the same aspect ratio as the original 
image, but smaller than the original image (20%, for example), and located 

30 in the center of the image. The magnitude of the weight in area A2 may be 
designed to be larger for pixels closer to the center of the subject area. Figs. 
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2l(a)-2l(c) show an example of such weight W. The difference from Figs. 
20(a)-20(c) is that in area A2, magnitude of the weight W is larger closer to 
the center of the subject area. By so doing, images in which an area in 
proximity to the subject area center in area A2 is blurry can be excluded 
5 from output images 

[0102] Where subject area information includes not just center 
coordinates for a subject but also information relating to the outline of the 
subject area thereof, this subject area can be used as the predetermined 
area A2. By so doing, more appropriate output target decisions can be 
10 performed on subject area information included in image generation record 
information. 

[0103] In this way, where image generation record information includes 
subject position information (subject area information), by determining an 
image quality parameter using a weighted distribution in which the area in 

15 proximity to the position of the subject is more heavily weighted, output 
target decisions can be performed more appropriately. It should be noted 
that, in this embodiment, the image quality parameter (weighted average 
edge amount) is determined by analyzing both image data and image 
generation record information. 

20 [0104] F4. Embodiment 4 of Image Selection Based on Sharpness 
Characteristic of an Image- 

Figs. 22(a), 22(bl), 22(b2), 22(d), 22(c2), and 22(d) illustrate the 
output target decision process of this embodiment. A difference from the 
embodiment shown in Figs. 20(a)-20(c) is that the threshold value is not a 

25 predetermined value, but rather the average value of edge amount 
calculated using equal weight throughout the image. On the image IMG in 
Fig. 22(a) is provided a predetermined area A3 whose center is situated at 
the subject area center. Figs. 22(bl) and 22(cl) illustrate a weight Wl 
distribution for calculating a weighted average edge amount as an image 

30 quality parameter. Figs. 22(b2) and 22(c2) illustrate a weight W2 
distribution used for calculating a threshold value. Weight Wl is constant 
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within area A3, while outside of area A3 it is zero. Weight W2 is constant 
all over the image. Weighted average edge amount EWave calculated 
using the weight Wl represents a localized characteristic of sharpness in 
area A3, whereas threshold value Eth calculated using weight W2 
5 represents a characteristic of sharpness of the overall image. 

[0105] Fig. 22(d) shows the output target decision process in this 
embodiment. In this embodiment, image data whose average edge amount 
EWave obtained using the weight Wl distribution is equal to or greater 
than threshold value EWth calculated using weight W2 is selected as an 

10 output target. Image data whose weighted average edge amount EWave is 
less than threshold value EWth is excluded as an output target. That is, 
sharpness in a predetermined area is compared with sharpness of the image 
overall, and image data in which sharpness in the predetermined area is 
sharper, for example, image data in which a subject in proximity to the 

15 predetermined area is in focus, is selected as an output target, while image 
data in which sharpness in the predetermined area more blurry, for 
example, image data in which a subject in proximity to the predetermined 
area is out of focus, is excluded as an output target. The threshold value 
EWth in this embodiment assumes a different value for each image data, 

20 and is a value determined by sharpness of the overall image. Thus, the 
output target decision for image data generated under various conditions 
can be executed more appropriately for the particular image data. 
[0106] The weight Wl distribution is determined such that heavier 
weights are assigned to an area that is desired to be sharper, as compared 

25 to the weights assigned to other areas. For example, the various weight W 
distributions in the embodiments described hereinabove can be used. As 
the weight W2 distribution used for calculating the threshold value Eth, a 
smaller weight may be used. By so doing, more images can be selected as 
output targets. Alternatively, a distribution in weight of an area desired to 

30 be sharper is smaller than weight in other areas may be used. By so doing, 
comparison of an area desired to be sharper with other areas can be 
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performed more precisely. As a weight W2 distribution of this kind, a 
remainder distribution obtained by subtracting weight Wl from an equal 
distribution could be used. 

[0107] F5. Variant Example of Image Selection Based on Sharpness 
5 Characteristic of an Image- 

In the preceding embodiments, the average value of edge amount 
is used as a characteristic value relating to sharpness in an image, but 
various other values could be used. For example, the proportion of edge 
pixels to the total number of pixels could be used as a characteristic value 

10 relating to image sharpness. Here, "edge pixel" refers to a pixel having an 
edge amount that is greater than a predetermined edge threshold value. 
This edge threshold value may employ a value determined on the basis of a 
sensory test of image output results. For example, where the range of 
possible brightness values is 0-255, a value of 40 may be used as the 

15 predetermined edge threshold value. Edge pixels tend to be fewer in 
number in blurry images, and greater in number in sharp images. Thus, 
by selecting as output targets image data whose edge pixel proportion is 
equal to or greater than a threshold value, blurred images can be excluded 
from output targets. For example, the predetermined threshold value may 

20 be set to 20% of the total number of pixels. In this example, the image 
quality parameter (edge pixel proportion) is determined by analysis of 
image data only, without utilizing image generation record information. 
[0108] As this edge pixel proportion, there may be used a weighted edge 
pixel proportion in which the number of pixels is counted using a weight 

25 distribution that assigns greater weight to areas intended to be sharper, in 
an manner analogous to calculating weighted average edge amount in the 
preceding embodiments. By so doing, decisions can be made placing 
greater emphasis on areas intended to be sharper. In such a case, the 
threshold value for deciding the magnitude of the weighted average edge 

30 amount may consist of a proportion of edge pixels calculated using equal 
weight throughout the image, or a proportion of edge pixels calculated using 
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different weights depending on the location in the image, rather than a 
value predetermined in the manner of Embodiment 4 described hereinabove. 
Where weight distribution is set using subject position information included 
in image generation record information, the image quality parameter (edge 
5 pixel proportion) is determined by analyzing both the image data and the 
image generation record information. 

[0109] G. Image Selection Based on Brightness Characteristic of an 
Image- 

Gl. Embodiment 1 of Image Selection Based on Brightness Characteristic of 
10 an Image : 

Figs. 23(a)-23(d) illustrate the output target decision process of 
this embodiment. The three images IMG23a -IMG23c shown in Figs. 23(a) 
-(c) are images of a human figure. These images differ in brightness from 
one another. Image IMG23a has high brightness, image IMG23b has 

15 proper brightness, and image IMG23c has low brightness. In the high 
brightness image IMG23a, the brightness value of each pixel tends to be 
high, so average brightness value is large. In the low brightness image 
IMG23c, the brightness value of each pixel tends to be low, so average 
brightness value is small. When generating image data, the exposure is 

20 ordinarily adjusted so that the amount of light received by the image 
generating device is the proper amount. Where exposure deviates from the 
proper value, for example, where it is greater than the proper value, the 
amount of light received by the image generating device will be greater than 
the proper amount, so that bright image data similar to image IMG23a is 

25 produced. On the other hand, where the exposure is smaller than the 
proper value, the amount of light received by the image generating device 
will be less than the proper amount, so that bright image data similar to 
image IMG23c is produced. 

[0110] Fig. 23(d) illustrates the output target decision process of this 
30 embodiment. In this embodiment, average brightness value Bave is used 
as the characteristic value relating to image brightness. Image data whose 
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average brightness value Bave is within a predetermined proper range 
between a lower limit value Bthl and an upper limit value Bth2 is selected 
as an output target. Image data whose average brightness value Bave is 
outside the predetermined proper range is excluded as an output target. 
5 By so doing, excessively bright image data and excessively dark image data 
can be excluded as output targets. A range determined through a sensory 
test of output results could be used as this proper range. For example, 
where the range of possible brightness values is 0 255, a predetermined 
proper range of 50 or above to less than 200 could be used. It should be 
10 noted that, in this embodiment, the image quality parameter (average 
brightness value) is determined by analysis of image data only, without 
utilizing image generation record information. 

[01 11] As the average brightness value, there may be used a weighted 
average brightness value calculated using a weight distribution that assigns 

15 greater weight to areas intended to have more proper brightness, in an 
manner analogous to calculating weighted average edge amount in the 
preceding embodiments. By so doing, decisions can be made placing 
greater emphasis on areas intended to be brighter. Where weight 
distribution is set using subject position information included in the image 

20 generation record information, the image quality parameter (average 
brightness value) is determined by analyzing both the image data and the 
image generation record information. 

[0112] G2. Embodiment 2 of Image Selection Based on Brightness 
Characteristic of an Image" 

25 Figs. 24(a)-24(d) illustrate the output target decision process of 

this embodiment. The three images IMG24a -IMG24c shown in Figs. 24(a) 
■(c) are images of a fruit. These images differ in brightness from one 
another. Image IMG24a has high brightness, image IMG24b has proper 
brightness, and image IMG24c has low brightness. In the high brightness 

30 image IMG24a, the brightness value of each pixel tends to be high, so the 
proportion of pixels whose brightness value is the maximum value within 
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the range of possible brightness values tends to be high. The pixels having 
the maximum brightness value will be referred to as "clipping pixels" 
because their original pixel values, which could be more than maximum, 
were usually clipped to the maximum value. On the other hand, in the low 
5 brightness image IMG24c, the brightness value of each pixel tends to be low, 
so the proportion of pixels whose brightness value is the minimum value 
within the range of possible brightness values tends to be high. The pixels 
having the minimum brightness value will be also refereed to as "clipping 
pixels." In image IMG24a, the clipping area where brightness value at 

10 maximum value is indicated by vertical hatching. In image IMG24c, the 
clipping area where brightness value at minimum value is indicated by 
horizontal hatching. The number of clipping pixels is greater the greater 
the extent to which the quantity of light received by an image generating 
device at the time of image data generation deviates from the proper 

15 amount. For example, where the exposure during generation of image data 
is greater than the proper value, there tends to be produced an image 
containing a large number of clipping pixels whose brightness value is 
maximum value, as in image IMG24a. On the other hand, where the 
exposure is smaller the proper value, there tends to be produced an image 

20 containing a large number of clipping pixels whose brightness value is 
minimum value, as in image IMG24c. 

[0113] Fig. 24(c) illustrates the output target decision process of this 
embodiment. In this embodiment, the proportion of clipping pixels Crate is 
used as a characteristic value relating to image brightness. Image data 

25 whose proportion of clipping pixels Crate is below a predetermined 
threshold value is selected as an output target. Image data whose 
proportion of clipping pixels Crate is above a predetermined threshold value 
is excluded as an output target. By so doing, excessively bright image data 
and excessively dark image data resulting, for example, from improper 

30 exposure setting at the time of generation of the image data, can be 
excluded as output targets. A value determined through responsive 
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evaluation of image output results could be used as this predetermined 
threshold value. For example, the threshold value could be set to 10% of 
the total number of pixels. The proportion of clipping pixels whose 
brightness value is maximum value and the proportion of clipping pixels 
5 whose brightness value is minimum value can be evaluated separately; and 
threshold values for deciding the magnitude of each proportion can be 
mutually different values. By so doing, the output target decision process 
can be executed while taking into consideration differences between the 
effects on image quality of pixels whose brightness value is maximum value, 

10 and the effects on image quality of pixels whose brightness value is 
minimum value. Instead of the proportion of clipping pixels, the number of 
clipping pixels could be used as the characteristic value relating to image 
brightness. By so doing, a output target decision process that is not 
dependent on image size could be executed. 

15 [0114] H. Image Selection Based on Camera Shake Characteristic of an 
Image- 

HI. Embodiment 1 of Image Selection Based on Camera Shake 
Characteristic of an Image" 

Figs. 25(a)-25(c) illustrate the output target decision process of 

20 this embodiment. The two images IMG25a and IMG25b shown in Figs. 
25(a) and 25(b) are images of a human figure. The difference between 
these two images is that image IMG25a was generated with a relatively 
brief exposure time, whereas image IMG25b had a relatively long exposure 
time. In image IMG25a, the human figure is sharp. In image IMG25b, on 

25 the other hand, the human figure is blurred. When the orientation of the 
image generating device changes during the time that the image generating 
device is exposed to light, the position of the subject within the image 
changes, so that the resultant image is a blurred image. This blur is called 
camera shake, and is more likely to occur the longer the exposure time, so 

30 that an image that is blurred due to camera shake, like image IMG25b, is 
more likely to be produced the longer the exposure time. 
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[0115] Fig. 25(c) illustrates the output target decision process of this 
embodiment. In this embodiment, the exposure time Ef is used as a 
characteristic value relating to camera shake. The exposure time Ef can be 
acquired using exposure information included in the image generation 
5 record information GI (Fig. 3), or a parameter value for shutter speed 
information. Image data whose exposure time Ef is equal to or less than a 
predetermined threshold value is selected as an output target. Image data 
whose exposure time Ef exceeds a predetermined threshold value is 
excluded as an output target. The longer the exposure time Ef is, the more 
10 likely an image that is blurred due to camera shake will be produced. 
Accordingly, by excluding from output targets image data whose exposure 
time Ef exceeds a predetermined threshold value, output of images that are 
blurred due to camera shake can be reduced. A value determined through 
responsive evaluation of image output results could be used as this 
15 predetermined threshold value. For example, a threshold value of 1/15 
second could be used. It should be noted that, in this embodiment, the 
image quality parameter (exposure time) is determined by analysis of image 
generation record information only, without utilizing image data. 
[0116] H2. Embodiment 2 of Image Selection Based on Camera Shake 
20 Characteristic of an Image* 

Figs. 26(a)-26c) illustrate the output target decision process of 
this embodiment. The two images IMG26a and IMG26b shown in Figs. 
26(a) and 26(b) are images of a car against a background of trees. While 
these two images were both produced with a long exposure time of the 
25 image generating device at the time of image generation, image IMG26a 
shows an image produced with the time setting set manually and 
intentionally by user, whereas image IMG26b shows an image produced 
with the time setting set automatically. In image IMG26a, the trees in the 
background are not blurry, while the moving car appears blurred in the 
30 direction of travel. In image IMG26b, on the other hand, both the 
background trees and the car are blurred due to camera shake. Certain 
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image generating devices allow the exposure time, for example, the shutter 
speed, to be set by the user. The user can deliberately set a slow shutter 
speed in order to produce an image that creates the impression of motion of 
a subject, or an image capturing a night scene with sufficient brightness. 
5 For example, to generate an image representing motion of a car by means of 
blurring, as in image IMG26a, a slow shutter speed would be intentionally 
used. 

[0117] Fig. 26(c) illustrates the output target decision process of this 
embodiment. The difference from the example in Fig. 25(c) is that a 

10 decision based on the type of setting mode for the exposure time (shutter 
speed, for example) is added as a condition for image selection. In this 
embodiment, a decision as to whether the exposure time has been set by the 
user is executed using a parameter value for exposure program information 
(Fig. 5) obtained by analyzing the image generation record information GI. 

15 Exposure program information identifies an exposure adjustment mode 
defined by shutter speed and/or aperture value. Exposure adjustment 
mode in which shutter speed is set by the user could include, for example, 
shutter speed priority mode (parameter value" 4) and manual mode 
(parameter value* 1). Where the parameter value of exposure program 

20 information is 1 or 4, i.e., where shutter speed has been set manually by the 
user, the image data is selected as an output target regardless of exposure 
time Ef. Where shutter speed has not been set manually, a decision 
process similar to the process shown in Fig. 25(c) is executed on the basis of 
exposure time Ef. By so doing, image data produced with the exposure 

25 time set by the user can be selected as an output target, regardless of the 
duration of exposure time. It should be noted that, in this embodiment, the 
image quality parameter (exposure time) is detei'mined by analysis of image 
generation record information only, without utilizing image data. 
[0118] H3. Embodiment 3 of Image Selection Based on Camera Shake 

30 Characteristic of an Image" 

Figs. 27(a)-27(c) illustrate the output target decision process of 
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this embodiment. The two images IMG27a and IMG27b shown in Figs. 
27(a) and 27(b) are images of a human figure. These two images are based 
on image data generated under low-light or dark conditions, and the 
exposure time is quite long. Image IMG27a shows an image produced with 
5 firing of a supplemental light source, such as a flash, whereas image 
IMG27b shows an image produced in the absence of a supplemental light 
source. In the image of image IMG17a, the human figure appears bright 
and sharp. In the image of image IMG 17b, on the other hand, the human 
figure appears dark, and is blurred due to camera shake. When image data 

10 is generated under low-light conditions, the image generating device tends 
to set a longer exposure time in order to be able to let in more light. 
However, when image data is produced while firing a flash or other 
supplemental light source to illuminate a subject, the image generating 
device receives virtually all of the light during the flash time in which the 

15 flash is fired. That is, the exposure time will be substantially equal to the 
flash time, even where the image generating device has been set to a long 
exposure time. The flash time is extremely short, for example, 1/200 
second or less. Thus, image data produced while firing a flash is not likely 
to be blurred due to camera shake. 

20 [0119] Fig. 27(c) illustrates the output target decision process of this 
embodiment. The difference from the example in Fig. 25(c) is that a 
decision based on whether a supplemental light source has been fired is 
added as a condition for image selection. In this embodiment, a decision as 
to whether a supplemental light source has been fired is executed using a 

25 parameter value for flash information (Fig. 5) obtained by analyzing the 
image generation record information GI. Where the operation result in the 
flash information is Flash on, it may be decided that a supplemental light 
source has been fired. Further, in the event that a reflected light sensing 
mechanism is provided, and additionally reflected light is present, it can be 

30 decided that a supplemental light source has been fired. Where a decision 
result that a supplemental light source has been fired has been made by 
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analyzing flash information, the image data is selected as an output target 
regardless of the exposure time Et. Where a decision result that a 
supplemental light source has been fired cannot be obtained, a decision 
process similar to the process shown in Fig. 25(c) is executed on the basis of 
5 exposure time Ef. By so doing, image data generated by firing a flash can 
be selected as an output target, even if the exposure time is quite long. In 
this embodiment, the image quality parameter (exposure time) is 
determined by analysis of image generation record information only, 
without utilizing image data. 

10 [0120] H4. Embodiment 4 of Image Selection Based on Camera Shake 
Characteristic of an Imaged 

Figs. 28(a)-28(c) illustrate the output target decision process of 
this embodiment. The two images IMG28a and IMG28b shown in Figs. 
28(a) and 28(b) are images of a human figure. Image IMG28a shows an 

15 image produced with a relatively short lens focal length, so that the human 
subject appears small and sharp. Image IMG28b, on the other hand, shows 
an image produced with a relatively longs lens focal length, so that the 
human subject appears large, and blurred due to camera shake. Lens focal 
length is a value that represents the distance between the center of the lens 

20 and its focal point, which is on the film or photoreceptor element such as a 
CCD. Longer focal length produces a larger image. Longer focal length 
also causes greater positional deviation of a subject in an image due to 
deviation in the orientation of the image generating device. That is, the 
longer the lens focal length and the greater the zoom of the image, the more 

25 susceptible the image will be to blurring due to camera shake, even where 
the exposure time is brief. On the other hand, the shorter the lens focal 
length and the smaller the zoom of the image, the less susceptible the image 
will be to blurring due to camera shake 

[0121] Fig. 28(c) illustrates the output target decision process of this 
30 embodiment. The difference from the example in Fig. 25(c) is that a 
threshold value Etthd for deciding the magnitude of the exposure time Et of 
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the image generating device is set with reference to lens focal length. Fig. 
29 is an illustration of the relationship between threshold value Etthd and 
lens focal length in this embodiment. Threshold value Etthd is designed to 
be inversely proportional to lens focal length. In this embodiment, the 
5 parameter value for lens focal length (converted to 35 mm film basis) 
information obtained by analyzing the image generation record information 
GI (Fig. 3) is used as the lens focal length. Using a threshold value set 
with reference to lens focal length, image data whose exposure time Et is 
equal to or less than threshold value Etthd is selected as an output target, 

10 so that the output target decision can be executed more appropriately on the 
basis of susceptibility to camera shake. This threshold value Etthd may 
also be designed to decrease in stepwise fashion over a plurality of steps in 
association with increase in lens focal length. By so doing, adjustment of 
threshold value Etthd can be accomplished by means of a simple process. 

15 Decisions as to the magnitude of exposure time Et using a threshold value 
set with reference to lens focal length can also be used in other 
embodiments wherein image selection is based on the aforementioned 
camera shake characteristics. It should be noted that, in this embodiment, 
the image quality parameter (exposure time) is determined by analysis of 

20 image generation record information only, without utilizing image data. 

[0122] The parameter value for lens focal length (converted to 35 mm 
film basis) information is a value obtained by converting actual lens focal 
length to lens focal length in a camera that uses 35 mm, under conditions 
that maintain the ratio of photoreceptor element size to lens focal length. 

25 Image blur due to camera shake is more likely to occur at higher image 
zoom. Image zoom is a value that changes not only with lens focal length, 
but also with the ratio of lens focal length to photoreceptor element size or 
film size. Thus, susceptibility to camera shake must be decided upon using 
the ratio of lens focal length to photoreceptor element size or film size of the 

30 image generating device. The parameter value for lens focal length 
(converted to 35 mm film basis) information in this embodiment is a value 



PF04J261US 



- 34 - 



that has been calculated in advance taking into account the size of the 
photoreceptor element. Thus, by determining a threshold value using the 
lens focal length converted to 35 mm film basis, a process for adjusting 
threshold value on the basis of different film or photoreceptor element size 
5 in different image generating devices can be dispensed with. 

[0123] I. Example Arrangement of Another Output Target Confirmation 
Process- 
Fig. 30 is an illustration of another example showing confirmation 
of output target image data on monitor 14. The screen shown in Fig. 30 is 

10 a screen for the user to confirm or modify output target image data in the 
output target confirmation process of Step S104 in Fig. 10. Two images of 
flowers are shown on the screen. The difference from the embodiment 
illustrated in Fig. 14 lies in that the displayed images are divided into a 
plurality of areas, shown with the areas having the highest proportion of 

15 edge pixels highlighted by double lines. The image at left on the screen is 
an image in which the flowers in the center of the image are in focus; the 
image at right is an image in which the flower at the bottom of the image is 
in focus. By confirming the area that is highlighted on the basis of the 
number of edge pixels, the user can readily identify which subject in the 

20 image is in focus. That is, output target image data can be readily 
confirmed or modified based on focus condition. At the bottom of each 
image are displayed a number of image quality parameters for use in the 
output target decision. Referring to this information, the user can more 
appropriately confirm or modify output target image data. 

25 [0124] Highlighted area in each image can be selected on the basis of 
various characteristics other than the proportion of edge pixels. For 
example, areas having the highest proportion of clipping pixels may be 
shown highlighted. By so doing, the user can readily confirm whether 
large numbers of clipping pixels are present in proximity to a desired 

30 subject. The method of dividing images may be a predetermined method, 
for example, a method of dividing an image into nine areas as shown in Fig. 

- 35 - 



PF04J261US 



30, or be designed so that the user can indicate the division method. 
[0125] Highlighted areas may be displayed by processing pixel data that 
have a predetermined characteristic. For example, color of edge pixels may 
be changed to red in order to highlight them. Pixels having another 
5 characteristic, for example, clipping pixels, may likewise be highlighted by 
changing the pixel color. By so doing, the user can readily confirm the 
distribution and quantity of pixels having a predetermined characteristic 
within an image, thus further facilitating confirmation and modification of 
output target image data. 

10 [0126] J. Arrangement of Another Image Output System- 

Fig. 31 illustrates another example of an output system by way of 
an embodiment of the present invention. Image output system 10B 
comprises a digital still camera 12 as an image generating device for 
generating image files; and a printer 20B as an image output device. As 

15 the image output device, a CRT display, LCD display, or other monitor 14B, 
or a projector could be used instead of printer 20B. In the following 
description, it is assumed that printer 20B is used as the image output 
device. This embodiment differs from the output system embodiment 
described previously (Fig. l) in that the printer 20B serving as the output 

20 device has, in addition to an output section for outputting images, a judging 
section and a selector for performing output target decisions. 
[0127] An image file created in digital still camera 12 is transferred to 
printer 20B via a cable CV, or by directly inserting into printer 20B a 
memory card MC having the image file stored thereon. Printer 20B 

25 executes the aforementioned image data processing (Fig. 10) using the read 
out image file, and outputs images based on image data that has been 
selected as output targets. 

[0128] The arrangement of printer 20B in this embodiment may be 
similar to the arrangement of printer 20 (Fig. 7, Fig. 8) in the embodiment 
30 described previously. In this embodiment, the control circuit 30 (Fig. 8) 
executes image data processing (Fig. 10) in addition to the image output 
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process. CPU 31 of control circuit 30 executes image data processing; RAM 
33 temporarily stores operation results from CPU 31, and image data; and 
PROM 32 stores data needed for image data processing, such as an output 
target decision program. That is, CPU 31, RAM 33, and PROM 32 function 
5 as a judging section and a selector. A memory card slot 34 (Fig. 8) acquires 
data from an installed memory card MC. 

[0129] An image file GF generated by a digital still camera 12 is 
transferred to printer 20B via a cable or via a memory card MC. When 
CPU 31 receives an image file GF, it executes the image data processing 

10 routine (Fig. 10) described previously. 

[0130] CPU 31 reads out the received image file (Step S100) and 
executes an output target decision process (Step S102). After recording the 
output target decision result in RAM 33, CPU 31 executes an output target 
confirmation process (Step S104). In the output target confirmation 

15 process, the user can confirm or modify output target image data through 
control panel 29. Where control panel 29 does not have size sufficient to 
display the screen shown in Fig. 14 or Fig. 30, control panel 29 may instead 
be designed to display number and/or file name identifying the image data, 
and the number of copies of each image, so that the user can modify the 

20 number of copies. Once the user has completed modification/confirmation, 
CPU 31 outputs images based on the output target image data. In this 
embodiment, an image output process is executed instead of the image data 
output process (Step S106). 

[0131] In this embodiment, printer 20B is furnished with a judging 
25 section and a selector, so the output target image data selection process can 
be executed automatically, without using an image data processing device 
such as a computer PC. 

[0132] As described in the embodiments hereinabove, the output target 
decision process is executed automatically, so that the effort by the user 
30 entailed in selecting output targets may be reduced. Since the output 
target decision can be made using various different conditions, more 
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appropriate output target decisions can be made. 
[0133] K. Variant Examples: 

The present invention is not limited to the embodiments set forth 
hereinabove, and may be reduced to practice in various modes without 
5 departing from the scope and spirit thereof^ the following variations are 
possible. 

[0134] Kl. Variant Example 1 = 

The output target decision process in the embodiments 
hereinabove may be executed by making decisions based on a plurality of 

10 decision conditions, and the decision results combined appropriately using 
logical sum or logical product functions to determine a final decision result. 
For example, in one possible arrangement, a decision is made regarding 
camera shake; image data for which the decision result has been to exclude 
it as an output target is subject to an additional decision on the basis of 

15 average value of edge amount; and only if the second decision result for this 
image data has been to exclude it as an output target, is it then excluded as 
an output target. By so doing, output target decisions can be made more 
appropriately. The method for combining a plurality of decision results on 
the basis of plurality of decision conditions in order to determine a final 

20 decision result may be determined on the basis of sensory test of image 
output results. 

[0135] K2. Variant Example 2: 

An arrangement is also possible wherein decision conditions used 
in output target decisions are determined depending on information 

25 included in image generation record information GI . For example, where 
image generation record information GI includes shutter speed information, 
flash information, and exposure program information, image data for which 
Flash On or exposure time has been set manually may be selected as an 
output target independently of exposure time, while still executing output 

30 target decisions for other image data on the basis of exposure time. Where 
image generation record information GI includes shutter speed information 
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or exposure time information, a final decision result may be determined 
using a decision relating to camera shake and a decision based on the 
proportion of edge pixels; or where shutter speed information and exposure 
time information are not included, a final decision result may be determined 
a decision based on the proportion of edge pixels only. By so doing, it is 
possible to make output target decisions that effectively utilize information 
included in image generation record information GI. 
[0136] K3. Variant Example 3: 

The output target confirmation process (Step S104 in Fig. 10) may 
be omitted from the embodiments hereinabove. In this case, images based 
on output target image data selected automatically by the selector will by 
output by the output section. By so doing, image output can be executed 
without the user having to select whether images should be output targets. 
[0137] K4. Variant Example 4: 

In the embodiments hereinabove, an arrangement wherein the 
image generating device comprises an analyzer and selector for performing 
output target decisions is also possible. For example, the control circuit 
124 of the image generating device, namely, digital still camera 12 (Fig. 2), 
may function as an analyzer and selector for performing output target 
decisions. Control circuit 124 will execute the image data processing 
described above (Fig. 10) using a generated image file GF. In the output 
target confirmation process (Step S104), the user can confirm or modify 
output target image data via the liquid crystal display 127 and Set button 
126. Once the user has finished modifying/confirming, control circuit 124 
stores the output target image data on memory card MC. In this variant 
example, a process to store image data on memory card MC is executed 
instead of the image data transfer process (Step S106). Output target 
image data stored on memory card MC may then be transferred to a printer 
or other output device via a cable, or via the memory card MC. In cases 
where additional image data processing is to be performed on output target 
image data, an arrangement wherein the output target image data is 
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transferred to a computer or other image data processing device is 
acceptable. In this variant example, digital still camera 12 functions both 
as an image generating device, and as an image data processing device 
comprising an analyzer and selector for performing output target decisions. 
5 [0138] K5. Variant Example 5: 

In the embodiments hereinabove, an arrangement whereby 
picture quality adjustment processing is performed prior to executing output 
target decisions is also possible. For example, a sharpness adjustment 
process to adjust image sharpness to an appropriate value, or a color 
10 balance adjustment process to adjust image color balance (e.g., RGB color 
balance) to appropriate values may be used. By so doing, image data 
whose picture quality has been improved through picture quality 
adjustment processing may be selected as output targets. An arrangement 
whereby picture quality adjustment processing is performed subsequent to 
15 output target decisions is also acceptable. By so doing, images having 
improved picture quality can be output. 
[0139] K6. Variant Example 6: 

In the preceding embodiments, an Exif format file was described 
by way of specific example of the image file GF, but the format of the image 
20 file pertaining to the present invention is not limited to this. That is, any 
image file containing image data generated by an image data generating 
device, and image generation record information GI describing conditions at 
the time of generation of the image data is acceptable. Using such a file, 
appropriate output target decisions may be made based at least on either 
25 image generation record information GI or image data GD. 
[0140] K7. Variant Example 7: 

In the preceding embodiments, a digital still camera 12 was 
described as the image generating device, but image files could be generated 
using a different image data generating device, such as a scanner, and 
30 digital video camera. 

[0141] K8. Variant Example 8: 
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In the preceding embodiments, there is described a case wherein 
image data GD and image generation record information GI are contained 
in the same image file GF; however, image data GD and image generation 
record information GI need not necessarily be stored within the same file. 
5 That is, it is sufficient for image data GD and image generation record 
information GI to be associated with each other; for example, it would be 
acceptable to generate associating data that associates image data GD with 
image generation record information GI; store one or several sets of image 
data and image generation record information GI in independent files; and 

10 refer to the associated image generation record information GI when 
processing the image data GD. This is because, in this case, although the 
image data GD and image generation record information GI are stored in 
separate files, at the point in time of image processing which utilizes image 
generation record information GI, the image data GD and image generation 

15 record information GI are in inseparably linked, and thus function 
substantially the same as if they were stored in the same file. That is, the 
term image file GF in the present embodiment includes those of a form 
wherein image data GD and image generation record information GI are 
associated, at least at the point in time that image px^ocessing takes place. 

20 Also included are motion video files stored on optical disk media such as 
CD-ROM, CD R, DVD-ROM, and DVD RAM. 

[0142] Although the present invention has been described and illustrated 
in detail, it is clearly understood that the same is by way of illustration and 
example only and is not to be taken by way of limitation, the spirit and 
25 scope of the present invention being limited only by the terms of the 
appended claims. 
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